Transfer learning for nonparametric classification: Minimax rate and adaptive classifier

نویسندگان

چکیده

Human learners have the natural ability to use knowledge gained in one setting for learning a different but related setting. This transfer from task another is essential effective learning. In this paper, we study context of nonparametric classification based on observations distributions under posterior drift model, which general framework and arises many practical problems. We first establish minimax rate convergence construct rate-optimal two-sample weighted $K$-NN classifier. The results characterize precisely contribution source distribution target distribution. A data-driven adaptive classifier then proposed shown simultaneously attain within logarithmic factor optimal over large collection parameter spaces. Simulation studies real data applications are carried out where numerical further illustrate theoretical analysis. Extensions case multiple also considered.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Minimax nonparametric classification - Part II: Model selection for adaptation

|We study nonparametric estimation of a conditional probability for classiication based on a collection of nite-dimensional models. For the sake of exibility, diierent types of models, linear or nonlinear, are allowed as long as each satisses a dimensionality assumption. We show that with a suitable model selection criterion, the penalized maximum likelihood estimator has risk bounded by an ind...

متن کامل

Minimax and Adaptive Inference in Nonparametric Function Estimation

Since Stein’s 1956 seminal paper, shrinkage has played a fundamental role in both parametric and nonparametric inference. This article discusses minimaxity and adaptive minimaxity in nonparametric function estimation. Three interrelated problems, function estimation under global integrated squared error, estimation under pointwise squared error, and nonparametric confidence intervals, are consi...

متن کامل

Minimax Optimal Alternating Minimization for Kernel Nonparametric Tensor Learning

We investigate the statistical performance and computational efficiency of the alternating minimization procedure for nonparametric tensor learning. Tensor modeling has been widely used for capturing the higher order relations between multimodal data sources. In addition to a linear model, a nonlinear tensor model has been received much attention recently because of its high flexibility. We con...

متن کامل

Minimax Kernels for Nonparametric Estimation

SUMMARY The minimax kernels for nonparametric function and its derivative estimates are investigated. Our motivation comes from a study of minimax properties of nonparametric kernel estimates of probability densities and their derivatives. The asymptotic expression of the linear maximum risk is established. The corresponding minimax risk depends on the solutions to a kernel variational problem,...

متن کامل

Minimax Classifier for Uncertain Costs

Many studies on the cost-sensitive learning assumed that a unique cost matrix is known for a problem. However, this assumption may not hold for many real-world problems. For example, a classifier might need to be applied in several circumstances, each of which associates with a different cost matrix. Or, different human experts have different opinions about the costs for a given problem. Motiva...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Annals of Statistics

سال: 2021

ISSN: ['0090-5364', '2168-8966']

DOI: https://doi.org/10.1214/20-aos1949